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“ a counselors. "art L Hepehoebenaplets have <a moral obligation 


‘and some practical it Hiatal to make demonstrable, the effective- 
‘ ‘ . 


’ 


“ess of" their treatments, Out Gf divas concerns, psychologists 
, ’ 7 ‘ e ¢ . rE: 

r , . ¢ 

are giving',more attention to explicating and’ evaluating their 

ie AB as. a: ae 5 

N treatments. Among some ofthe older methods recomended in 


. the literature that have accountability relevance for treatment, «| 


et ’ 


the follow- -up study has} long been mentioned, However, information 


concerning the use of follow- ~up studies in, ‘counseling hag ‘yemainel 


’ ‘ 


h 
peereriducligtte? THis stugy réports the results of an exploratory 


"follow-up study intended to generate ideas about its utility in 
serving accountability concerns, -The results of the study ‘plus 


a search of the-relevant literature suggested ways for the: , 
s conducting, monitoring aad follow-up of treatment, ' The describe 


procedures were then examined‘ for their “Svaluative % significance 


\ . . : a ao 
a / r , = AT . 


o> challeng¢g in demonstrating the ef tiveness of their treatments. 


The subject of treatment efficacy began in earnest with the 


-publi¢ation of Bysenck”’s 1952 paper,.and the controversy concerning 


Ww og - * 
' * efficacy (or lack’of it) has, not yet abated, This question 


alone is Seyxous aes 3 to caps aes ethical concerns among psychol- 
gists, Het even more sisfoming vossiblidties exist, In an 


exhgtistive review of psychotherapy effectiveness, Bergin (1971) 


‘ 


7, concluded that there are probably ‘good results from.some treat- 


ments, ‘bdd results pee others, ahd overall, a cancelling efiect| < 
which av¢rage@s out to a misleading total figure. The possibility\ ; 


of dele tprious effects ‘underlines the importance of using only ‘\ 


tested amd demonstrably ef fettive treatments, Until-the ent Poi} , 


of using ‘only tested treatment interventions is accomplished’, Hoek \ 


| 
- + ye > 
it can Ve argued that: counseling al sey ahothedany is an abstruse’ \ 


-~-*+-. large where one man’s opinion - whether trained or untrained, - is \\ 
as “good as the next (Sorenson, 1967). oe ! \ 
7 4 What should have been a mail imperative on the part of . - af 
‘pewetbelag guycholoyiats has now become ‘a very pra¢tical state \\ 
; of affairs, A portion of the zeitgeist of the Ametjcan public ' oe 


is reflected in the rising consumer movement, and as a‘consequence \ 
words like "accountability" have become increasingly common, sy 


Psychologists cannot afford to ignore this situation. : | \ 


Out of the above concerns, psychologists are giving more , 4 
» \ é > 
x attention to explicating and evaluating the treatments they use. © | 


Among some of the older methods recommended in this area, the 
mo ; : ¢. : 


* use of follow-up studies has “ mentioned in the literature. 


. 1. 


4 -_ 


r 


has beer unsystematized, In the direction of attaining 
f : " 


& 


Its supporters. have included Eysenck (1966),| Bergin and Strupp 


(1970), Williamson (1952) and Fiske (1974), but information 


g@ccountable methods, the preSent study’ reports resullts ‘of a 
4 4 


ly 
ee 


\ 


follow-up study. The study was “intended to generate ideas 


concerning the usefulhess of the follow-up ‘as| a step |toward 
\acgountable methods, re results of the study plus aj search 
|suggest ways of conducting» mo itoring | f 


of relevant literature 
and. follow-up of treatment and how such methods may bé useful 


Studies 


in an’evadluative context, 
. \ 
» 
Literature Review of Follow-u 
’ 


, 


For one, follow-up does not usually in- } 


In connection with \follow-up procedures in therap 
outcome studites, Bergin 


1971) reported that there havé been con- 


or 
sistent deficiences, 
clude intensive observation procedures such as those that 
If the period of time between 


occur during the therapy period, 
treatment termination and follow-up goes unobserved, qne never 
’ . 


{ 
| 


knows what..are the long range effects of treatment,- This occurs 
because there is no precise detétmination of what-the intervening 


influences may hdve been that affected the client's status, 
® , . 
Periodic fluctuations in posttreatment functioning could be 
s 
° 


plotted, and environmental events and interpersonal encounter 
. ‘ 
The contribution 


. 


could be correlated with these. fluctuations, 
of such inquiry would be to cast more light on the natural 


history of the condition treated,and to reveal more accurately 


which changes can be validly attributed to the influence of the 


treatment, 
» : 2. 


9) 


- . pee . ad ‘ 
. Follow-up study is well .sujted for investigating long-term 


ry 
. ’ 


goals of treatment, This may be of some significance if the . 
desired behavior is nat expected to manifest itself until -= «4 


some point in the future, Sinc® the comparison of behavior 


\s - 
\ 


. Wes = 
from one time pie riod to’ another can be. methodologically cumber- 


4 7 , 


| 

i F \ . P 3 A ; 

| . some, aS it usually is when investigators attempt-to make post- . 
hoc evaluation’ of trgatment, it is important that the invest~- , 


° igator collect: iteasures of pre-treatment and during-treatment 


functioning. Without a baseline from which follow-up data can 
; “Up 


be compared, there is no reasonable way to make inferences con- 


*, 


clieht behavior change over time, This point will be 
. ’ ry a ** 


. | s 
cerning 
Pe. 


elaborated upon in the discussion of the model. eo? “* 


+ ooh 
. a4 The usefulness’ of follow-up has been mentioned nymerous 
times: in the literature, but serious investigation has been 

dlmost preaches Eysenck (1966) stated: that follow-up research 
has been‘neglected by the researcher and therapist alike, and 
advocates the systematic Lavesttgieten of therapy outcone, 


Bergin and Strupp (1970) argued for research that would specify 


",,,mechanisms of change, their experimental refingment, and ' 
their practical elaboration," \Eysenck further noted that the 

. t ‘ , ; 
follow-up was important for stu of long teryti effects that ‘ ~ a 
would allow for more precise investigation of post-therapeutic 
improvement or regression. ‘ 


. 


r * , The usual follow-up study examines a program or treatment 


e H 
at some future point in time in order to'determine if the client 
‘ ( 


have acquired some set of specified skills,- changes in beliefs, 


> i ? 7 
investigate whether some SreeeES ses ag at the conclusion of 


treatment will Temain stable over time, This type of follow-up 
essentially follows an an excbst- facto design, whereby the exper- 
» imentor attempts to relate, after the fact, the treatment to an 


auibeone recorded at Some time aikas the administration of the 


. 


, “op 


Noting the lack of using follow-up studies, Kremer (1970) 


treatment, cc ai. a. .3 


maintains that it is * probably the single most neglected geben 


2 


function, and nentions three possibilities for thi's: a lack of 


time on the part of counselors to-devote to this kind of work; ’ 
. @ . ‘ 


a lack of money budgeted for this kind of work; and a lack of 
secretarial work to ‘secomplish the paper work AHN AYES Hutson 
a (1968) “holds that follow- “up studies are “made only sporadically, 
that they are poorly Beit and that few institutions or people 
conduct them on a vagules basis, 
Concerning the ne thodo logical side of cqnducting follow-up 


studies, much of the CPE RSuae, DOvORsey sss the prevalent 


measuring device is the questionnaire,/even though this type of 


? a 


; , be é . re 
measurement device is prone to many hazards in the kind of data 


it produces, Accounting far gnon-responders is another problem, 
since incomplete samples most likely yield biased results Cho tines 


and Mooney,1952). 


Little (1970) further’criticized the use of follow-up 
studies for their failure to use recommended statistical analyses, 
Also, .there is said to be & fehlure to deSign studies in which | 
sophisticated ao) lea analyses would either be appropriate 


4. + 


¢ 
! 
| 
5 
4 


«ele 


‘or helpful. Stemming from inadequate design and, statistjcal 


ag 


‘ . qe ‘ 
analyses, there.occurs major errors of inference in eStablishing ri 


causal relationships among variables, - | . 
_ Summary, ‘in regard to a short review of a sparse lit- <i 


erature, it was “noted. that: ’ 


: 
1. Follow- up i aa cls receiver less than 100% re~ ye 
F ‘ 1° Frat eS 


sponse réturn,” with evidence that incompiete samples yield biased — 


. s) te . er - 
_* vesults, ~ ; { : ; 

. y - - « . 
2 The instguments cht have been used have ye tedy been -* 


. 


either the questionnaite or a chaos eeuletie information / *, 
ce . 
, being only ,as extensive as the mature of the measuring device, 


a> 3. Follow-up studies’.are usually planned at some poingeafter 
the. conclusion of treatment; making the conclusions from make-shift 


a Ps - 
fdesigns limited, \ as 
. . . . 
ot , Z . > i ‘ 
_ 4... The -statistical“analyses employed have not*always been 


os . « 
_ . ” . i 


appropriate to the design apedh tieiding npaateuent information: 


' ! Pa 5 . A 


ee and ¢onclusions, 


ri 


i ss . S. Such stypdies have been characterized as being: weak ig *s! -<— 
their ‘design and inadequate in their stetinebont treatment, partly 
) _ «due to the fact that eke” stakes were not conceived as research 
. fron the beginning stages. 2t . 2 ex, 


> - . 


‘ . 
6.’ Between the time of-treatment termination and follow-up 


. ’ ” 


. there has been Ng control against the influence of experimental 
: o 


history in accounting for any observed change.-: a 


- . 3 Mig 


ar : Exploratory Follow- Up Study .. & 
: For the purpose of Suita Bhieg ideas about the strength ‘and 


weakness ‘of follow-up Study, as it relates to accountable’ methods 
- . ~ . 


% “ ‘ » 


% J . td 
a " . oF A a 2 Ss aie : = , | ‘ 


ca - 4 : " x “e: 


Te .in counsedi ng and psychotherapy, the author ‘has condusted a., 


ee. Te Boy ca 
‘follow- -up study of eolitegs students, “ALL erodants , attended 


Bie ee _ Bag. Bondo college in Whittier, California) where ‘ie stu@ants 


. Oi ‘% 


“Ss ‘had -taken part in a* ‘group ounseling experience in 1973, «At the 


7 "+ time the follow-up was conducted it Was of interest as to how .: 0 3) 
5 ; _ informatidn egllected after the completion of treatment could be 
= : used, to improve that treatment in subsequesit‘use, . 

- Subjects. “Eleven Sut. o2 the possible 22 ts Puen: claenits were 
a “contacted by telephone and interviewed one year siter “counseling. 


rs 2° All “subjects had been in counseling for career counaeltaes and 


~all- took part in’a replicable group coungeling procedure: described 


wo by Healy (1974). a V , ; 
= : ft ‘ as 
a : ‘Measure, A thirteen item strustured interview guide was constructed, 


~ ~~—=™~ -All ‘items weré ‘open-ended’ to- allow subjects the freedom of report- M- 
' : ‘. ¢ 


" ing theia most salient memories,. This freedom of resppnding 
» . * x . , : 
was felt to be important in order to avoid the inaccurate ; 
‘ ‘<3 iif 
‘ of 
: classification of responses according-to a priori chosen categories, 


ae a ae 6 ‘ \ : 
This measurement bias is discussed in.a later portion of the 
s . a ' he ° 
paper dealing with actorrobserver interactions in redording data, 
. > ‘ aoe ‘ ‘ 


While ‘the construction of the guide allowed for.some freedom of 
s er : : 
responsé, the nature.of the guide's structure insures data that 


is related,to specific areas, allowing for comparison among individ- 
. : , ‘ 
*s ‘ uals, .(Ste' appendix A) * * — : ; | 


e : / 


: Procedure, Eleven former client) were contacted by telephone, and 


° 2 
interviewed by. the author, In addition to adhering to the ANESESANE * 


and éxdex of the interview guide, respondants were. also encouraged ‘ 


“ ‘« !to discuss any other facet of. the counsel fib experience, After 


‘ ; the completion of telephone calls, and respondants replies recorded, 


eee . , . * : : ee : : ; , 
,™ the results were analyzed according» to their content, ~ x 
: . uv ’ ‘s * % ’ . . 


Results. Responses were Clue tangs into categories’ including 
‘ 


tee 


- 


i> ,° areas bf Perceived Help, Change of Plans and “Activities, , ' 


if - 


Recaminen dations for’ ‘Improvement, Most Memorable Component of 


‘Counseling, and Needed Assistance after one’ year geen the tedakaae . 


e| 
a tion. of counseling, 
In the gluster of* Perceived Help, three identified ateas . > 
eee X 


were in situ Lea eine: ability, knowledge of self, and inter-. 


personal ‘conmunication, Changes of Plans that were reported 

_ could only be intexpreted “as did or negative depending upon 
the seca aan chniext in which they occurred, ‘ Changes in-plans o 

m % .could alternately\ be eiepel anes &s- changes indica five of further 

a refinement vf decidions, or of-further confusion, Recommendations 

po for ag SER aE "included ‘the desire for bettas leadership and 

coordination by. group leaders; adhe apaed Bia information after 

4 *%. the conclusion of group. counseling fiike [60 ‘ontzy? revel require-_ 


A ments » salaries, prospects ate a alee etc. Ve and, a strong’ 


, desire. for aa ai follow- eo on an individual basis. Most 
- respondants spoutaneousty reported positive appraisgl of the | @x- 


° perience, and recognized such opportunities .as the ability to. : 


.°.  * gain newer perspectives on thinking by hearing other group members, 
V ‘ we ; 
ana. in gaining a mo rknowledge of self, Percentages of responses 


\ 
to specific Categories are as: follows’: Stimulated to “seek further’ 


caréer information (63%), examine fit of'occupation (¥5%), ability 
to see peers plans (100%), opportunity to, systematically examine 
self (72%},_no change of plans or incidental changes (M1 %), and 


~ 


thaas having 4 positive evaluation of the experience (634). 


, * 


, a oe eg” Me yA ‘> is oe 


J 


- 


. 


a » 
Again, the purpose of ‘the follow-up was not to systematically 
evaluate the efficacy of,treatment, but to tiiehio abate con- 
cerning methodology for improving treatment. Of particular’ 
‘ ‘ : 


importance was tthe observation that grouped data processing tends: 


28 Or : o>. .% : 
to obscure some very caliente clinical information, An individual's 
aia gain toward some desired objective should be an important 


ex itexton ‘for efficacy, but’ it becomes élouded in typical pre 


. 


and post difference comparisons, For exampge yy let us aSsume that 


a 


-5 people only have a theoretical value of 2 in scene" solving 


ability, while another 5 people have a gomaeiahl value of 10 


“in problem solving ability. All ten of these people Begin with 


ay. 


6 


{ 


a counseling treatment which includes as one of its goals the 


. 


increase of problem solving ability. After these Wen people’ 


. ; 4 us 
finish with the counseling treatment,, letyassume that the counselor 


again measures problem-solving ability to assess,any change from 
. Fa . . a = \ 
pre to post treatment, If we assume that all 10 people terminate 


with a problem solving value of 10, than traditional nomothetic 
eo ‘ “4 
analysis yields the following results and interpretation: 
PreTreatment X (N=10) PostTreatment X 


6 - 10 


— 


Problem solving ability almost. doubles for the clients of the 


counséling treatment! This analysis obscures’ the fact that in 
actuality 5 people make nonsignificant gain while the remaining 


5 make spectacular gain in problem solving ability. Merging the e 


’ . ‘ : . 
two groups cancels out the effects that differentiate one group 


from another, producing a kind of cancellation that Bergin (1971) 


discussed in his review on treatment efficacy, . 


ee : Another limitation ofthe type of follow-up used in this 


¢ 


paper (which is typical of most follow- ups used) is the repeated 


incomplegé ‘gample return rate that questionnaires are notorious ; 


) 


for, There is reasonable suspicion that a 50% return would pro~ 
duce biased results in unknown ways, 


le It was also. apparent: that unless some type of baseline is: 


| provided before aad during the exeebuent, systematic evaluation .. 
1 of treatment effect$ is near-impossible, 


Procedures for Monitoring and Follow-Up 


In reviewing the types of experimental and quasi-experimental 


designs that: allows an ongoing and future evaluation os a treatment 


‘ 


Or sa Program, ° many of the beste were some variation of time 
bey 
é series analysis (See Campbell and.Stanley,1963). So .called AB, 


ABA, and ABAB designs are basically designs which call for the 
recording of “baseline along vias the withholding or application 


4 -of treatment, These. appeared to have. little utility ina daily ha 


a . schedule of a . busy psychologist; where the therapist éanaot 


¢ easily withhold™ or apply treatment strategies in order to determine 


change, ‘This App OSes np ractical as‘a tool that can guide 


treatment, ou % , « 


Yet another variation of _ ee desigh exists, one 
\that addresses a raised in the results of the'exploratory, . 


ay see oo | 


follow-up, called the intensive research design, WVarjous writers 


ve have discussed this design within the context of psychological 
* preatment (Rhoresen and Anton,1974; Gottman and. Leiblum, 1974; ane 
Chassan and Bellak 1966) and’ eee would appear to be much rel- ~ 
evance to ‘the present discussion,’ 
ee The essential components of such a design is ite it is 


oe @ . 
: 9 
tt 


<r idiographic, provides information about change on an ongoing . 


paals, and provides gre necessary design and statistical | ; . 


» auepintheneta for making reasonable. inferences about glient o 


behavior change, In one nethod discussed by. Thoresen (1972), ; 4 


2 
: ‘  pbehavior ts_ observed ane plotted before id during treatment, 


Target" behaviors are those which are consistent 4 tty eahand omathy 


- . 5 i 


Stated goals of the treatment inbapventie’. Since there is only 


a i one subjéct in each coll of a design ellis the client serves 


‘ 


7 as, his’ or her ‘own cont ro§ in a repeated measures design, Alternate 


¢ 2 ° + 
iekeviovs selected according to their functional autonomy gf the 


target behaviors are also observed and recorded, In this way con-,, 
. \ Hl ~ $ . 


* current observation of control and target behavior can be eval- 


% uated in terms of ‘di fforential a a or: eaadints The behaviors 
* - 
aig! observed both before and ier ne treatment, The same behavior 


can be repeatedly monitored at any point in the future, which , 


ee oP ae would then constitute folfow-up.” The amount of control variables 
s ee y = . 
*. ‘can easily invive. more than One behavior, as is true for target, 


' 


behaviors (See Figure .1). 
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Gottman and Leiblum (1974) in discussing the aiveteuy ree 


time series Suggested that behavior be plotted ciaicie and during 


treatuent, and instead of} plotting multiple diehiawt ans "of the 


same client, behavior is ‘plpetea’ for more than one individual. 


e 


-. In this case one individuay!s behavior (no breatment) serves as 


a control for the clients behaWor (See figure 2.), 


. 


r : BS 
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Figure 2. Example of thé Interrupted Time Sasies” Design, — me. 


These Sashes aré opén to the same crititisns as most ‘time- * 


series analyses, especially the lack of control° for i saa tia 


nes tony in acgounting eve the observed behavior sais al To counter 


this weskuees of the sieht ‘hypothesis, Gottman, Me Pall, and ‘Barnett: 
“ (1969) Bropoedd a design called the "tine lagged SEREEED"s design, a 


+. ° 
While ice the pievious design there was one treatmegt, the time 


lagged woe design incorporates a se ond. intervention to another 


individual at a different “time, The figure below illustrates not: P 
- ® ? ie z 


om an indépendent 


# 


only a control for*the target behavior, but 
3 
Bee 
# 


' replication of the effect, 


. 


~l begins curing 
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Intérvention 
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- Baseline 
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Figure 3.Exgmple of the Time Lagged Control Design, 


-From the previous discussion it is recommended that folflows 


- 


up bea component that is decided’ upon before treatment 39 ( that = ae 
(tees steps can be taken to insure its design and sta (seical ) 
seq aRCy As pointed out ‘previously, without a henaliny, for... 
comparison purposes, no reasonable. inferences are ‘poss ble concerny 
ing pre and post treatment hai change, . The ‘perch ntages report- 
7 ed in. the results section simply refleot the time pdriod from. 
which they were sampled: and indicate soithina wait chance from 
pre-treatment funétioning, | 

i After this is taken note of, jrelevant clien behaviors have 

“to be chosen along with the selection or constr ction of appropriate 


shofild be tai lore’ j 


® ¥ 


measuring devices. ihe type of measuremen 
to the type of ere ‘outcome, but Thore en (1972) re an that 


counseling goals be stated in behavioral fterms, In this behavioral 


context, Tatings of behavior (such as dajly logs of tatget ms 


Mes 


are useful, Other goals might be more menable to self-report 


‘ ; ‘ 
“data concerning affective states, Archival data*can be very 


/ . ‘ hae 14 


F ie 
useful within a timg-series design and institutions that keep 


regular records, suph as schools and hospitals, are likely sources, a 


§ » ae 


* \ , ‘ : ' 
. , Archival records provide excellent unobtrusive measures of 
‘ . 

behavior, such as attdndance records would provide a school 


psychologist ina referral for chronic truancy, But whether the 
$ . A 


4 


e ‘ ; : i ' : 
data are derived from fecords ,observations, self-report inventories, 
cd \ 


or other measurement nehns, they play an important role in 
4 - 
_ the intensive. dé@Sign, . ‘ ae, a 


. En regard to the time interval between observations or 
. = be . 


“measurements, there are nd rules and are idiosyncratically determ- 
‘Mined. The only generalization that can be made is that too many 


measurements are better than too few, 


With the type of single case design being discussed, it, should 


be hoted that its usefulness is nore in the area of generating 
hypotheses than-it is in confirming them (Kieslar,1971), The 

comprehensive character of the data on one judiviewas makes the 
change process more explicit and less reliant upon inference for 


understanding, 


‘ 


As Thoresén points out,’ intensive designs minimize the. .: 


* 


use of statistics to control for individual variability, Instead, 


ry 


behavior, variability is not seen as accidental but as a function 
, 


. 


of the circumstances’ operating in the current environment of the 


subject, Thus, client behavior change that varies contiguously 


a 


with treatment is thought to be a function of the treatment. 

Concerning the Statistical analysis OM time-series data, st lt 
is first noted that*eise series is the repitition of two or more 
‘measurements of the same wwebatite at different times, This pro- 
vides a basis for infering whether the intended change thas or- 


. 


LS. 


‘ rz a 
hasnot taken place, In‘such a déSign time is the master variable 
° ' > ole ‘ 


The main purpose is tp gain 


- 


enough. insight. into- the internal structure af the total time- 


against which all else is otdered, 


seriesto permit valid gengralizations about the system's ‘behavior, 


Three cautions that should be mentioned are: 


. 


1) Time as the. 


major ordexing variable can bring with. it countless other variables, 


r only. some. of whieh can’ be, adequately controlled by the investigator; 


2) The time interyet between observatfons is afbitrary and for , 


‘ 


continous varhables can be made, infinitely smal ; and 3) Repeated 


.: \ hg 
observations through time are often sequentiakly dependent, 
rendering invalid many of the usual statistical models which re- 
‘quire independenée of observations ‘Gloltzman, 1963). « 


€ 4 


’ For a more detailed sabia sales reader, is referred to, 


Rao (1959, 1968), ie ei Roy (1964), Khatri (1966), Grizzle and 
Allen (1969) 5 and Algina and Swaminathan (2975). A brief description 


is provided below, 


a a, Data must first ba identified as either i dependent or depen- 


hen observations . - 


‘ 


dent, with different pro edures for analysis, 


oO 
are said to be pre n ’ eee are said to vary randémly ait 


some constant value,’ When there is ‘Sufficient rift away Sten 


. ® \ 
the constant value, then change can be as$umed koi ‘have occurred, 
. 4 


Practica ly speaking, this would simply involve computations for 


‘ 


* the mean| and standard a ea of observed behaviog, and determin 
ing whether two successive obse vatiotf, occur outside of the two ° 

. . seafuned dj deviation band (Gottman ‘end Leiblun, 1974), , . 9 

For! ; dependent ShERSTAELODE, dyta are axeuined to determine ' 

s/ if the data are autocorrelated, Lf data are ‘autocorrelated, then 


peebiecien n at sdme tine in the future’ is possible sy ead the 


: 
| ck 


a , : . then data,is said 


trends of past eveNts, Autocorrelation is determined by first 


1 calculating the correlatioh coefficient for sequential time-unit ~ 
. : \ ; . 
differences, that is by pairing observations as in the first order 
autocorrelation of observation Lewith 2x 2 with 3, 3 with'4 etc,. 
This is noted as the autocorrelation of lag 1 and ee 
- sutocorrelations of increasing lag are calculated. The- “correlations 
\are then ‘plotted as a function as ‘lag, yielding a correlogram of 


obtained g@utocorrelations, The sestiel correlation coefficient for 
. 


lag k is obtained, using the es equation (Holtzman,1963): 


a “Gs N-k:; . 3 ’ “ 
, 22-2) a “Ar he 
; : tek. -. , ‘ 
t=l .- ; N= number of observa- 
rs z : tions : : 
“3K :, k= lag 
; N . - 4 ; Z= measurement ‘ 
é 2 ‘ , 
: L(zeZy- | Y. 
- ot ( / 
tal a . . a 9 


a is sented for si pni ficance uSing! Bartlett's test. If *, is 


greater than aie where N leben fhe number of observations, 


. 


to bd dependent and ry, is i iareiseed different from zero. If 
Tk is less’ than 2K, or not significantly different from zero 

¢ 
at(&=.05, then ‘the data is considered independent and the first 


r% 


‘ éneerthadaansivets is used, +If dependent data exbst, then ue 


: a moving average or a firse-differences trang formation ¢an be: per- . ‘ 
formed, elinating the linear trend, and enabling the ‘use of" analysis. 
* ‘ef indepetident observations, * - : 
In zeenary of the methods destribed, it has been said that -~ 
| effective follow-up also mans effective treatment monitoring. By 
eaployi vga series of ongoing measures that provide feedback to 
a 2 3 P 8.19 s ] 


the therapist. about the effectiveness of his or her eatment, 
a baseline is epee provided that can be used for comparing 

a differences in future behavior, Three vapyiations of Lantendive 

\ design were illustrated, as well as a ne cautions and 
procedures, Statistical treatment was also described, in order 
to make more valid apptbisals of the obtained s Lope, representing 
behavior chines 


“Ny , . 
¢ . : ae 7 
¢ B. P Discussion. r 


In the variations of intensive study, described im the 
. . 2 e ra Be ai 
‘ ; ¥ s «af ; ; 
preceding portion, repeated and accurate. weasurement is crucial, 


. 


f 


- Within the context of Thoresen's discussion, counseling go'als 


are behavioral ones, and measurement would be likely to entail 
. , 
b@havioral observations or ratings of behavior, ; 


» | ’ 
a 4 il 


WF voasurepent of this type appears to be prone to a particular 


 faip of bias that should be noted, The bias has to do,with actor-" 
‘ » ‘ ’ 


observer differences in ‘the way in which events are perceived and 
7 ne oy 
\ analyzed by individuals, both counselor and client alike (Jones | 
3 é % 


‘and Nisbett, 1972).- Actors of behavior are’ said to differ from 


’ °° 


buasecess of behavior not only in sarc to what data each has, 


‘available! for interpretation, but also in the way i'n data is pro- 
* iy : % # . . 
cessed, Individvals are thought to perceive théir own behavior 


‘as determined by stimulus ‘factors, or yalences in the enviroment, P, 


while. the behavior of others al alas as due to personal traits, 
4 
Observers, or Spexiaeators, see Behavior as "figure" vgatust a 

~ ground" of the enviromental Suntext, teading to a bias in viewing 


* , the way in which an individdal acts, In an intensive s tudy where 


Ped behavioral hantvinndons and ratifigs are being emplayed, there. » exists | 


# \ ‘ia 


§ at least <a aii that counselors/researchers might see 


c= 1 , ‘ . aig “ - 


Vs 


.' \ 


= . ; ‘ 
within behavior qualities more in the perception of the 
counselor ehey the motivations of the client. This caution W 


we > 


noted in kilpostts (1937) comment about. avy concerni aits, 
but has not been much heeded, The stifdy ‘was concerns 
oe of children's behavior into one] of various a priori |¢ 
chosen categories, Allport noted that one child may 1 becaus 

he is afraid of hurting the feelings 0 Skis teacher, while another 
may steal pennies in order to. buy facceptance from his ‘peers, Fdr 
‘neither of these two children do the behaViors of tying or. cheatiig: 


constitute items on a scalé called "honesty" which‘ was he case in 


1 


the stuny erbeinwed by éiivake, Similarly, within this paper's 


, 


o . . ‘ F * ‘ . 
cofitext,- counselors must ex¢rcise ¢aution when evaluating behavior 


against pre selected, behavioral goals of "success", There exists 


‘: the Ypossibility that cetoutlees behavior. may ‘ exist more in the 


i. : 
peteepees of the. experimentor than the ne of the Supject. 


v 


The approach decerited 4s in some ways very differnet from 
a - ‘ 
methodological approaches normally taken in efficacy research of 
psychotherapeutic treatment. , The first dijfference concerns ther ' 


length of the time spand sampled in'the subject's life. By the 
= . | x ‘ » 
very nature of the intensive design, intimacy and comprehensiveness 


is. explicitly sought, A second emphasis is in the amount of. depth - 


taken in investigating client change, Multiple measures of different 
., characters, such as behavior ‘observations coupled with self-réports .° 
of beliefs ‘are encouraged\ In Sum, more data of breadth and depth 
“is inoue analyzed in order to avoid fragmentary aspects of 
* ; 


behavior evaluation in artificial contexts, A like criticism was. 


1, Hartshorne and May (1928) 


se . | 9 ty 


made by Carlson (1971) in the area of personality research, 
. ; rr : . 
. Ld F a ¢ P . 
Carlson recommended more naturalistic, longitudinal, and single 
case study. alternatives to the predominate experimental use of 


--undergraduate psychology Students as gyubjects for sinee amounts 


= 


of time, The intensive design seems to incorporate these. 


" Pecommendations. . arene a ; i 
, . et e ee 
' The idea of. using comprehensive and relevant data is not 
a] z $ P . 
“a new idea, and it has been a hallmark of a type- of counseling’ 


expounded by WiLliamson, , Knowing as many of the relevant "facts" 


was important in a Williamsonian context because proper psycho- 


ae 


diagnosis was directly based upon it, Treatment was seen as being, 


only as adequate as an icainaiie. formulation of the problem, The: 
effectiveness of a treatment depended upon the proper collection . 
and analysis of relevant information, It would seem that’for.. 


research sPitnoses, ALeneEAE the adequacy of the- data is no less 
** 
of a concern, The ‘breadth and depth of the intensive iesiga is 


, , 
consistent with these concerns, a 


Concerning oe last point about "research"” and "practice" 
in Suchotbecatn, saunetees ig assumed which may .not be productive, 
Implicit in this™authors discussion of intensive designs in monitor- ° 
ne and follow-up of treatment is the sapien i's research 
‘and therapy practice’ are not seperate, The use of comprehénsive 
data reflecting client change” shonta gutis treatment in a form- 
ative evaluation manner, Pach wen piece £ information should be 
“applied to the previou's situation, aes | in turn néw situations 
to be refined and modified, The aided control and- reliability . 
provided by an intensive design is believed to make demonstrable . 


the effects of treatment and increase its potential for success, 


r 
wo 


5 ; : 18a 20 . . = 


{ 


oyu 


ie . - . - 
4. " 
~ 2 , * 


* By the increased information available to the therapist , less * 


reliance. is made on Loferences about client change, # the ; 


. i) 
4 


23 public character of client ehenag would pee ne ty have a peontoneing 


effect’ on ‘the client.as well, - ; . 
et gs } « 
The preveding Uivcuskdion on treatment noni toring and Peet cin 
up is thought “to point to differential esiphases in attitudes 
: - aevsy 
toward accountability is$ués in therapy, and uses of measures 
: A <4 if _ 
as progress indicators of treatment, We, Seem to know too Tittle 


of treatment brocess and. outcome ‘to fostes. on the public tech~ 


. 


niques with effects that we can only give educated’ guesses,- 
e o 
We sem to know’ too little about specific problem populations 
wh- s ~ . 


to allow theNuse of "generalist" treatments on "uniform" clients, 
A more basic= approach that illumintes the treatment process 
more clearly wouldgbe the appropriate first step, and this‘ 


presentation was intended to stimulate thought in ‘that ee 
: : : ae 


. F Nv . 
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